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Abstract 



In this paper the existence of a quadratic control Lyapunov function for bilinear systems is 
r ) ■ considered. The existence of a control Lyapunov function ensures the existence of a control law 

which ensures the global asymptotic stability of the closed loop control system. In this paper we 
will derive conditions for the existence of a control Lyapunov function for bilinear systems. These 
(~| . conditions will be derived for the whole class of two dimensional bilinear systems with one control 



input. This will lead to a simple flow diagram representation for the controller design for bilinear 
systems using a quadratic control Lyapunov function. The controller design itself is carried out 
using Sontag's universal control law |l| to obtain an asymptotically stable closed loop system. The 
Gutman control law H which, however, only ensures practical stability of the closed loop system 
»^ , but which is considerably simpler than Sontag's control law will also be considered. An example 

^ ' will conclude the paper. 



1 Introduction 

In this paper bilinear systems (BLS) given by the state space representation 

m 

x{t) = Ax{t)+^{Nix{t)+b,)u^{t), x{0)^x° (1) 



are in the focus of interest. In (m the symbol x{t) e i?" represents the state vector and u{t) e _R'" 
represents the vector of control inputs. The matrices A and Ni,i = 1, . . . ,m are real n x n matrices 
while the vectors bi,i = 1, . . . ,m are real n-dimensional vectors. Applying the results from |ll 0, H to 
K% ' the class of BLS it turns out that V{x) = x^ Px with a symmetric and positive definite n x n matrix 

^ . P is a control Lyapunov function (CLF) for ([l|) if and only if 



Y(x) := x'^iA^P + PA)x < V x e M -.^ \x e R'' 



x^O, yUN.x + hfPxf ^0\ (2) 



i=l 



is valid. If V{x) is a CLF the control law derived by Artstein and Sontag ||l|, 0] ensures the global 
asymptotic stability of the closed loop system. It should be mentioned that (w is identical with the 
design conditions derived by Gutman and Mohler [B for the controller design for BLS. However, in 
general the condition (g) is extremely hard to check and to fulfill. 

In a numerical study, where a large set of bilinear systems has been considered we were in all cases 
unable to compute a matrix P such that (0) is fulfilled. This numerical problem was the main motivation 
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to analyse the design conditions for a special class of bilinear system, namely, two dimensional single 
input bilinear systems given by the state space representation 

x{t) ^Ax{t) + {Nx{t) + h)u{t), x{{)) = a;° (3) 

where the two dimensional state vector is represented by x{t) — {xi{t),X2{t))'^ and the input u{t) is 
a scalar function of time. The matrices A and N are real 2x2 matrices and 6 is a two dimensional 
vector. For this class of bilinear systems the computation of a positive definite and symmetric 2x2 
matrix P = P"^ > for which 

Y{x) < Vx e M (4) 

is satisfied will be carried out. In this special case the above definitions for Y{x) and M are simplified 
to 

Y{x) = x'^ {A^ P + P A)x = x'^ Apx , (5) 

M = {x\x^O, {Nx + bfPx = 0} = {x\x:f^O, x^ NpX + 2x^ Pb ^ 0} (6) 

where the abbreviations 

Ap := A^P + PA, (7) 

Np :=: N'^P + PN (8) 

for the corresponding symmetric and real 2x2 matrices have been introduced. The set M defines 
a conic section in the cc-plane whereby the shape of this conic section depends on the eigenvalues of 
Np. For the analysis of the controller design a case study with respect to Np will be done. Especially 
positive definite, negative definite, semi definite and indefinite matrices Np and the case Np = have 
to be considered. In the following section a necessary condition for P will be derived from (Q). The 
third section contains a detailed discussion of the positive definite case Np > 0. The extension to the 
remaining cases will be outlined and the results for all cases are presented as a flow diagram. The paper 
ends with an example and the conclusions. It should be mentioned that most of the computations were 
performed using the computer algebra system MAPLE [|| . 

2 Necessary Condition 

The main goal in this section is to derive a necessary condition for P from the design condition (H). 
Because of Y{0) — the function Y{x) has to have a local maximum at a; = with respect to the 
constraint x e M because otherwise the condition (0) is violated in a vincinity of a; = 0. First we 
analyse if Y{x) has a local extremum if the constraint x'^NpX + 2x^Pb = which defines M is active. 
To answer this, we define the Lagrange function L{x, A) = x^ ApX + X{x'^NpX + 2x^Pb) using the 
Lagrange multiplicator A. The necessary conditions for a local extremum using the partial derivatives 
are calculated as 

ar .Pit , 

x'^NpX + 2x'^Pb = 0. (9) 

It is easily verified that A = 0,a;=:Oisa solution of (0) and consequently a; = is a local extremal 
point of Y{x) under the constraint x^ NpX + 2x'^Pb = 0. As discussed above a; = is required to be a 
local maximum. A necessary and sufficient condition [[7| for this is, that 

v'^{-g^{x'^Apx})v < (10) 



dL 


1 


1 


dL 


dx 


= 2{Ap + \Np)x + 2\Pb = 


= 0, 


d\ 
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is satisfied for all vectors v that satisfy 

= 0. (11) 



d_ 



v'^{ — {x^NpX + 2x'^Pb}) 



x=0 



The needed partial derivatives are -§^{x'^ Apx} = 2Ap and -S^{x^NpX + 2x^Pb}\ = 2Pb. The 
desired vectors v that are othogonal to Pb and therefore satisfy (^l|) are given by w = kJ P b where k 
is a non zero scalar. In the two dimensional case the matrix J is given by 

Now we are able to derive a condition that is equivalent to (11^) and dO). It is given by v^ ApV = 
n'^b'^Pj'^ApJPb < Vk e i?\{0} which can be simplified to 

b^PJ^ApJPb < (13) 

since k^ is positive. This condition will be simplified further. In the following we assume the pair {A, b} 
to be completely controllable and choose {A, b} in controller normal form such that 

where oq and ai are the coefficients of the characteristic polynomial of A. The positive definite and 
symmetric matrix P is parameterized as 

P=( ' "') (15) 

\ Pi P2 J 

where pi and p2 are real variables and the fact that P is determined up to a positive factor has been 
used to choose the (1,1) element to 1. To ensure P > the variables pi and p2 have to fulfill 

P2~pI>0. (16) 

If we use ( p^ and ( p^ in ( p^ ) the condition ( p^ is equivalent to pi{pf — P2) < 0. Using ( p^ ) this 
inequality reduces to 

Pi > (17) 

which is a necessary condition on P and will be central for the following computations. 

3 Sufficient Conditions 

In this section we discuss the controller design conditions for the case of a positive definite matrix 
Np. The main idea to analyse this situation is to carry out a linear state variable transformation 
to transform the set M into a circle. After this transformation we parameterize M and evaluate 
Y{x) Vx S M. In the following the transformed set M and the transformed function Y{x) will be 
called My and Yy{y), respectively. It should be mentioned that temporarily x — will be allowed in M 
for an easier calculation of the necessary transformation. After having carried out the transformation 
it will be indicated to which point x = has been transformed and the related transformed point will 
be omitted. For the positive definite matrix Np we carry out a cholesky decomposition g of the form 
Np = L^ L with a nonsingular matrix L given by 

h h 
h 



^=( ; ) (i«) 
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where li and I3 are positive. With this matrix L the above mentioned transformation is performed 
according to a; = L^^{y + j/o) '^ V = Lx — yo where y = {yi, 2/2)"^ represents the new state vector and 

» = -(L-Tp*=(^ ) = (»■;) (19, 

is an appropriate choice. Substituting x = L^^{y + J/o) into the equations which describe M leads to 
the transformed set 

My = {yeR^\yl + yl = a} with a = ^^l^i^^Hli]!i>lM! > (20) 

which describes a circle with radius ^/a in the y-plane. This circle is now parameterized using rational 
functions, thus, the transformed set My is represented by 

After having computed this representation of My we are now able to evaluate Y{x) \/x G Af , which has 
the same range of values as the transformed Yy{y) Vy € My. We compute Yy{y) — Y{L^^y + xq) and 
in order to evaluate Yy{y) \/y G My we further substitute 

in Yy{y) and compute Yy{y)\/y € My as a rational function Yy{t) of the real variable t. The function 
Yy{t) is required to be negative for all real values of the variable t to ensure that the design condition 
(Q) holds. Yy{t) is a very complex rational function of the form Yy(t) = j^, where numerator Z{t) and 
denominator N{t) are both polynomials of degree four in t. The denominator polynomial is computed 
as N{t) = '1^3(1 + i^)^ which is positive for all real values of t, thus, it can be ignored for the analysis 
of the sign of Yy{t). The numerator polynomial Z(t) is factored as the product of two polynomials of 
degree two given by 

Z{t) = {t-tof-P{t) with to = ~ ^7f'' , . (23) 

Va+ (-2/0,1) 
The special value tp corresponds to a; = and because a; = has to be excluded from M we require 
Z{t) < Vi S i?\{io}- For all values of i S i?\{io} the polynomial {t — tp)^ is positive so it does not 
influence the sign of Yy{t). Thus, P{t) is required to be negative for all real values of t in order to 
satisfy the design condition (|j). As mentioned above P{t) is a polynomial of degree two of the form 
P(i) = k2t^ + kit + fcoi where fc2, ki and ko are very complex expressions containing /i, I2, I3, pi, P2, 
ao and ai. If we require P{t) < for alH g i? the following two cases have to be considered: 

1. all coefficients ^2, fci and fco are non zero, thus, 

P{t*) < for some t* and kf - 4fcofc2 < (24) 

have to be fulfilled, in order to guarantee P{t) < for all real t; 

2. the coefficients fe2 and fci are zero and therefore P{t) — feg is constant and fco < has to be 
fulfilled. 

These two cases will be discussed in the following. First case one is considered. If t* — to given by (|2 
is chosen, the conditions ( |24| ) are computed as 

P{to)=8llllpiipl-p2) < 0, (25) 

kl ~ 4fcofc2 - 16piiqi^ + pih)^- 
■{iplao + plal — 2pip2aoai — 2piai — 2p2ao + plal + 1) < (26) 
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with /3 — {pih ~ P2hY + ivih)^- Considering the necessary conditions ([iq ) and ( [l7| ) one can easily 
conclude that condition ( psj ) is satisfied. It is also obvious, that the factor \Q(3l\l1{\/P + pil^Y i"^ (|2q ) 
is positive and consequently, 

(4p^ao + plal — 2pip2aoai — 2piai ~ 2p2ao + p\a^ + 1) < (27) 



is the only condition that is left. Condition (M) is now rewritten in two different forms, which are 
given by 

[(aiPi-aoP2)-l]' + 4ao(p?-P2) < (28) 

and 
[(aoP2 -oiPi) - 1]^ +4pi(aoPi -ai) < 0. (29) 

From (^8|) it is concluded that oq > has to hold if we consider P2 — p\ > from ( [iq ) . If we now 
use flQ > in (p9) it is obvious that ai > has to hold if we require pi > from (O). The following 
theorem has therefore been proved. 

Theorem The condition {Ap\aQ + p\a\ — 2pip2aQai — 2piai — 2p2ao +p|a§ + 1) < with respect to 
the conditions ( jTq j and m^ can be fulfilled if and only if oq > and ai > hold. Thus, the bilinear 
system with u = has to be asymptotically stable in order to allow the controller design in this case. 

In the following we consider case two (^2 — ki — and consequently fcg < 0)- Since ^2 and fci are 
both linear functions of oq and Oi we use fc2 = and fci = as a linear set of equations to calculate ao 
and fli. In other words: For which bilinear system (defined by ao and oi) is it possible, that this case 
occurs. The solution with respect to oq and oi is given by 

"n = /3Ar (P2 - pf) {hpi - P2lif Ij, (30) 

VpNko 

"1 ^ -^l^J—9{h,h,l3,Pi,P2) (31) 

where g{li,l2,h,Pi,P2) and Nk^ are very complicated expressions depending on h, I2, h, pi and p2. 
These values for ao and ai are substituted into the expression for fco and we compute 

ko^-'-^^{^P+P.hy{p2-pl). (32) 

The only interesting case appears if Nkg > holds since for this case ko is negative because the necessary 
conditions ( [l6| ) and (jl^) have to be fulfilled. Considering this case (Nkf, > 0), one can easily see from 
( P0| ) that ao > is valid if I2P1 — ^2^1 7^ holds. In the following the sign of ai from ( pi| ) is analyzed 
for the case I2P1 — P2I1 ^ 0, which reduces to the analysis of ^(/i, Z2, ^3,Pi,P2) since /? > holds and 
Nko > has turned out to be the only interesting case. The case I2P1 —p2h — will be discussed later. 
Introducing /ii = pih, /^2 — P2I1 > and /is = P1I3 > and using polar coordinates fiT, — rcos{ip) and 
Ml = M2 + rsin{ip) with r > and —^<ip<^we compute 

13 = {pih - P2hf + {pihf = if^i - t^2)^ + ^^l = r^ ^ y^=r (33) 

and gihj2,h,Pi,P2) = g{r,ip,H2) is given by g{r,ip,fi2) = 4r**cos(.^)(l + cos{(p)) q^Qq. Hereby, the 
two dimensional vector q ~ y r /i2 ) and the 2x2 matrix 

' 92 93 ' 
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with 



qi — P2 cos^ 



(f), g2 = b2-p?)cOs(|)sm(|), g3 = (p2-p2)3in2(|) (35) 

which is positive definite ii ip ^ have been introduced. Looking at this representation of g{r, Lp, ^2) as 
a quadratic form with positiv definite matrix Q it is obvious that g{li, h, h,PiiP2) > and consequently 
ai > from (^ holds ioi ip ^ -^ I2P1 — P2h 7^ 0. The case I2P1 — I1P2 = which belongs to (p = 
will be discussed in the following. For 1^ = the matrix Q is only positive semidefinite and the previous 



conclusions are no longer valid. Using I2P1 — I1P2 = and substituting I2 — —h into ( pO[ ) and ( pi] ) 
leads to 

Co = 0, ai = — (36) 

Pi 

which corresponds to a matrix A that is not asymptotically stable. Resuming the case of a positive 
definite matrix Np, the controller design is only possible if oq > and ai > hold if I2P1 ~ P2I1 7^ 
is valid. For the case P1I2 ~ P2I1 = a system with ao — and ai = — > can be allowed. In this 
case we arrived at an interesting point since we are able to design a controller for a bilinear system 
which is not asymptotically stable for m = 0. The remaining cases for Np are treated in the same style, 
namely, after the transformation of M into a representative set as circle, parabola or hyperbola the 
set is parameterized and Y is investigated. In the next section a flow diagram for controller design is 
presented containig all possible cases for Np. 

4 Flow Diagram 

In this section we give a flow diagram for the controller design for a two dimensional bilinear system 
with one input u. For the design we assume a system that is given in controller normal form such that 
the matrices A and b have the structure defined in (|lj). Each system where the pair {A, b} is completely 
controllable can easily be transformed into this normal form using a linear state space transformation. 
The results of the preceeding section and of the other cases to be treated are summarized in the flow 
diagram shown in Figure |l|. Using this flow diagram it is possible to calculate the required matrix P 
and carry out the controller design according to, e.g. Sontag ||l| or Gutman g]. 

5 Example 

We consider the two dimensional bilinear system in controller normal form with the system matrices 

Now we step through the flow diagram and have to answer the following questions which correspond 
to the shaded path in Figure |l|. 

1. Is the system asymptotically stable? We compute the characteristic polynomial p{s) — s{s + 1) 
and the eigenvalues of A as si = and S2 = —1; the system is not asymtotically stable. 

2. det{N) > 0, trace(A^) = 0, rin ^ and sgn(nii) = -sgn(n2i)? We compute det{N) = 2 > 0, 
trace(iV) = 2, riu = 1 7^ 0, sgn(riii) = 1, and sgn(n2i) = —1; these conditions are not fulfilled, 
since trace(A^) 7^ 0. 

3. Is ao = and ai > 0? We consider the matrix A and read ap = and oi = 1 > 0; these conditions 
hold. 

4. Is niifli + 7121 > 0? We compute nnai + n2i = 0; we continue with the "no" branch. 
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Figure 1: Flow Diagram for the Controller Design. 
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Figure 2: Simulation result for the closed loop system. 



5. Is niiai + 7121 = 0? We compute nnfli + 7121 = 0; this condition holds. 

6. Exist X > such that ri22 + 0'i{n2iX + ^12) = 0? We evaluate this equation and compute 
X = 2 > 0; we are able to compute the desired positive value of X. 

7. Compute pi and P2I We compute pi = -^ = j = 1 and p2^-^+X=j + 2~3. 

8. Set up the matrix PI We compute 



P 



1 Pi 

Pi P2 



1 1 

1 3 



9. Compute the control law. In this example the control law given by Gutman 

u = -a{Nx + b)'^Px = -a[Axl + xi+ ix2) 
is used. 



(38) 



Now we will check if the condition (H) holds. Therefore we have to evaluate Y — x^{A^P + PA)x for 
all vectors x that belong to the set M = {x & R'^ \ x ^ 0, x^ {N'^ P + PN)x + 2x^ Ph = 0}. We first 
compute the set M using x = {xi , X2Y' and we have M = {x € R^ \ a; 7^ 0, 4x2 + 2^1+ 3x2 = 0}. Now 
we evaluate Y for all a; G M and compute Y \x£M= — 4a;|, X2 ^ 0. This function is negative for all 
real values of X2 7^ 0. Thus, using this matrix P the design condition (0) holds and V{x) = x^Px is a 
CLF for the BLS (p^. Figure shows trajectories of the closed loop system for the choice a = j^ in 
(p8|). These trajectories clearly indicate the global asymptotic stability in this case. 
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6 Conclusions 

The controller design for bilinear systems is a very complicated task and only a few results for higher 
dimensional systems are available. Most of the recent publications treat systems with asymptotically 
stable system matrix in the linear part. In this paper the existence of a quadratic CLF for bilinear 
systems has been analysed systematically for the case of two dimensional systems with one input. This 
case is important because no systematic study for two dimensional systems has been carried out so far 
and the conditions (0) simplify with increasing number of inputs. Therefore, two dimensional systems 
with one input represent the first interesting case which has not been treated systematically up to 
now. We give necessary and sufficient conditions which ensure that the design condition (0) can be 
satisfied. The result of the complete analysis is presented as a flow diagram which guides the user 
through the controller design. This is the first complete systematic study of the conditions (pi) for a 
whole class of bilinear systems. In previous research only special examples have been treated or the case 
of bilinear systems with asymptotically stable system matrix of the linear part has been investigated. 
The important case with an unstable system matrix of the linear part has not been treated in the 
literature so far. This gap is closed by the results of this paper for the case of two dimensional bilinear 
systems with one input. An example illustrating the design is given at the end of the paper. 
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